Papers with Multi-Perspective Self-Consistency
Enhancing Large Language Models in Coding Through Multi-Perspective Self-Consistency (2024.acl-long)
Copied to clipboard
| Challenge: | Existing work utilizes verification properties to verify and re-rank solutions in a majority voting manner, but this assumption may not hold. |
| Approach: | They propose a multi-perspective self-consistency framework that incorporates both inter- and intra-consistency across outputs from multiple perspectives. |
| Outcome: | The proposed framework significantly boosts performance of foundation models on various benchmarks, including HumanEval (+15.91%), MBPP (+6.43%) and CodeContests (+9.37%). |